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COMPLEX OUTLIERS OF HERMITIAN RANDOM MATRICES 


JEAN ROCHET 


Abstract. In this paper, we study the asymptotic behavior of the outliers of the sum a Hermitian 
random matrix and a hnite rank matrix which is not necessarily Hermitian. We observe several possible 
convergence rates and outliers locating around their limits at the vertices of regular polygons as in ifTOll . 
as well as possible correlations between outliers at macroscopic distance as in ll25l and ifTOl . We also 
observe that a single spike can generate several outliers in the spectrum of the deformed model, as 
already noticed in fS) and Q. In the particular case where the perturbation matrix is Hermitian, our 
results complete the work of El, as we consider fluctuations of outliers lying in “holes” of the limit 
support, which happen to exhibit surprising correlations. 


1. Introduction 

It is known that adding a finite rank perturbation to a large matrix barely changes the global beha¬ 
vior of its spectrum. Nevertheless, some of the eigenvalues, called outliers, can deviate away from the 
bulk of the spectrum, depending on the strength of the perturbation. This phenomenon, well known 
as the BBP transition, was first brought to light for empirical covariance matrices by Johnstone in 
[l23ll , by Baik, Ben Arous and Peche in [I3]|, and then shown under several hypothesis in the Hermitian 
case in [|23[ni[l3lEl[30l[8ll9ll6ll7l[l5l|2l|25l. Non-Hermitian models have been also studied : 
i.i.d. matrices in |l32l [T2l |271, elliptic matrices in Il2^ and matrices from the Single Ring Theorem 
in [flOll . In ifTOl . and lately in ETl . the authors have also studied the fluctuations of the outliers and, 
due to non-Hermitian structure, obtained unusual results : the distribution of the fluctuations highly 
depends on the shape of the Jordan Canonical Form of the perturbation, in particular, the convergence 
rate depends on the size of the Jordan blocks. Also, the outliers tend to locate around their limit at the 
vertices of a regular polygon. At last, they observe correlations between the fluctuations of outliers at 
a macroscopic distance with each other. 

In this paper, we show that the same kind of phenomenon occurs when we perturb an Hermitian ma¬ 
trix H with a non-Hermitian one A. More precisely, we study finite rank perturbations for Hermitian 
random matrices H whose spectral measure tends to a compactly supported measure /i and the pertur¬ 
bation A is just a complex matrix with a finite rank. With further assumptions, we prove that outliers 
of H-t- A may appear at a macroscopic distance from the bulk and, following the ideas of ifTOll . we 
show that they fluctuate with convergence rates which depend on the matrix A through its Jordan 
Canonical Form. Remind that any complex matrix is similar to a block diagonal matrix with diagonal 
blocks of the type 


RpW ■= 
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SO that A ~ diag (R^j (0i),... ,Rp^(0^)), this last matrix being called the Jordan Canonical Form of 
A [[23 Chapter 3]. We show, up to some hypothesis, that for any eigenvalue 9 of A, if we denote by 


pu...,pi> P2,...,P2> ■■■ > Poo---,Pc 
'' -^ ^ ^-- 


the sizes of the blocks associated to 6 in the Jordan Canonical Form of A and introduce the (possibly 
empty) set 

:= |?€C, G„(|) = i} 

where G^(z) := f ^ il{dx) is the Cauchy transform of the measure /i, then there are exactly 
J Z 

jSipi H-h PaPa outliers of H +A tending to each element of We also prove that for each 

element ^ in y'e, there are exactly Pipi outliers tending to ^ at rate P 2 P 2 outliers tending 

to ^ at rate etc... (see Figure]^. Furthermore, the limit joint distribution of the fluctuations 

is explicit, not necessarily Gaussian, and might show correlations even between outliers at a macro¬ 
scopic distance with each other. This phenomenon of correlations between the fluctuations of two 
outliers with distinct limits has already been proved for non-Gaussian Wigner matrices when A is 
Hermitian (see [l25ll l. while in our case, Gaussian Wigner matrices can have such correlated outliers : 
indeed, the correlations that we bring to light here are due to the fact that the eigenspaces of A are not 
necessarily orthogonal or that one single spike generates several outliers. Indeed, we observe that the 
outliers may outnumber the rank of A. This had already been noticed in (81 Remark 2.11] when the 
support of the limit spectral measure of H has some “holes” or in the different model of [|5]|, where 
the authors study the case where A is Hermitian but with full rank and is invariant in distribution by 
unitary conjugation. Here, the phenomenon can be proved to occur even when the support of the limit 
spectral measure of H is connected. At last, if we apply our results in the particular case where A is 
Hermitian, we also see that two outliers at a macroscopic distance with each other are correlated if 
they both are generated by the same spike (which can occur only if the limit support is disconnected) 
and are independent otherwise (see Figure [^. From this point of view, this completes the work of [[61, 
where fluctuations of outliers lying in “holes” of the limit support had not been studied. 

The fact to consider a non-Hermitian deformation on a Hermitian random matrix has already been 
studied in theoretical physics (see [IT8irT^l^l2T]l l in the particular case where H is a GOE/GUE ma¬ 
trix and A is a non negative Hermitian matrix times i (the square root of —1). They proved a weaker 
version of Theorem |2. 3 1 in this specific case but didn’t study the fluctuations. 

The proofs of this paper rely essentially on the ideas of the paper [fTOll about outliers in the Single 
Ring Theorem and on the results proved in [|3^ 1311 |6l . More precisely, the study of the fluctuations 
reproduce the outlines of the proofs of ifT^ as long as the model fulfills some conditions. Thanks to 
ll30l [3T]| . we show that these conditions are satisfied for Wigner matrices. At last, using |j6} and the 
Weingarten calculus, we show the same for Hermitian matrices invariant in distribution by unitary 
conjugation. In the appendix, as a tool for the outliers study, we prove a result on the fluctuations of 
the entries of such matrices. 


2. General Results 

At first, we formulate the results in general settings and we shall give, in the next section, examples 
of random matrices on which these results apply. 


2.1. Convergence of the outliers. 
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2.1.1. Set up and assumptions. For all > 1, let Hyy be an Hermitian random N x N matrix whose 
empirical spectral measure, as N goes to infinity, eonverges weakly in probability to a eompaetly 
supported measure p 

1 ^ 

(1) Mm := ^ M- 

i=i 

We shall suppose that p is non trivial in the sense that p is not a single Dirae measure. Also, we 
suppose that Hyv does not possess any natural outliers, i.e. 


Assumption 2.1. As N goes to infinity, with probability tending to one, 

sup dist(A,supp(/i)) —)■ 0. 

AeSpec(HA^) 

For all A > 1, let A^v be an A x A random matrix independent from (whieh does not satisfies 
neeessarily A^ = Aa?) whose rank is bounded by an integer r (independent from A). We know that 
we ean write 


( 2 ) 


Aa? 




where U is an A x A unitary matrix and Aq is 2r x 2r matrix. We notiee that Aa? only depends on the 
2r-first eolumns of U so that, we shall write 


A^ := U2.AoU^„ 

where the A x 2r matrix U 2 r designates the 2r-first eolumns of U. We shall assume that Aq is de- 
terministie and independent from A. We shall denote by Oi,.. .,0j the distinet non-zero eigenvalues 
of Aq and their respeetive multiplieityj^ (note that Y,i=i < r). We eonsider the additive 

perturbation 

(3) Ha^ := HA?-l-AAf, 


We set 

(4) G^{z) := [—^p{dx). 

j z — x 

the Cauehy transform of the measure p. We introduee, for all / G {1,..., y }, the finite, possibly empty, 
set 

, and m, := CardA^e, 

We make the following assumption 
Assumption 2.2. For any 5 > 0, as N goes to infinity, we have 


(5) 


■= U e C\supp(At), G^(^) 


sup 

dist(z,supp(/i))>5 


U5AzI-Ha.)’‘U2, 




op 



0 . 


1. The multiplicity of an eigenvalue is defined as its order as a root of the characteristic polynomial, which is greater 
than or equal to the dimension of the associated eigenspace. 
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2.1.2. Result. 


Theorem 2.3 (Convergence of the outliers). For ki,..., kj, ,..., yQ. and as 

_ j 

defined above, with probability tending to one, Hiv := + Aa? possesses exactly ^ kinii eigenvalues 

i=l 

at a macroscopic distance o/supp/r (outliers). More precisely, for all small enough 5 > 0, for all 
large enough N, for all i & {1, • ■ ■, j}, if we set 

^Oi = { 1 ; • • • ; ^i,mi } , 

there are mi eigenvalues ...,ofHpi in {z, dist(z, supp(/i)) > 5} satisfying 

^i,n = <^,> + o(l), for aline {I,...,mi}, 

after a proper labeling. 


Remark 2.4. If all the 5^0-'^ are empty, there is possibly no outlier at all. This condition is the analo¬ 
gous of the phase transition condition in Theorem 2.1] in the case where the O/s are real, which 
is if 


1 

Oi 


€ 


lim G^(a:), lim G^(x) 

x^a x-^b+ 


where a (resp. b) designates the infimum (resp. the supremum) of the support of /i, then, 0, does not 
generate any outlier. In our case, if |0,| is large enough, yg. is necessarily non-empty^ which means 
that a strong enough perturbation always creates outliers. 


Remark 2.5. We notice that the outliers can outnumber the rank of A. This phenomenon was already 
observed in dBl in the case where the support of the limit spectral distribution has a disconnected 
support (see also [O). In our case, the phenomenon occurs even for connected support (see Figure 

[T(b)|). 


2.2. Fluctuations of the outliers. To study the fluctuations, one needs to understand the limit distri¬ 
bution of 


( 6 ) 


Vn U^,(zI-H^)-1U2.-G;,(z)I 


op 


In the particular case where H^y is a Wigner matrix, we know from [1^ that this quantity is tight but 
does not necessarily converge. Hence, we shall need additional assumptions. 


2.2.1. Set up and assumptions. As Ajy is not Hermitian, we need to introduce the Jordan Canonical 
Form (JCF) to describe the fluctuations. More precisely, we shall consider the JCF of Aq which does 
not depend on N. We know that, in a proper basis, Aq is a direct sum of Jordan blocks, i.e. blocks of 
the form 


(7) 


(d 1 (0)\ 


Rp(0) 



1 

0/ 


px p matrix. 


9 e C,p > I 


Let us denote by 6i,...,9q the distinct eigenvalues of Ao such that yg 0 (see (|^ for the de¬ 
finition of yg), and for each / = 1 ,... ,^, we introduce a positive integer a,-, some positive integers 
Pi,i > ■■■ > Pi,ai corresponding to the distinct sizes of the blocks relative to the eigenvalue 0, and 


2. due to the fact that the Cauchy transform of a compactly supported measure can always be inverted in a neighbo¬ 
rhood of infinity. 
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-2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 

(a) Spectrum of an Hermitian matrix of size N = 
2000, whose spectral measure tends to the semi¬ 
circle law jXsc{dx) := A- — x^l[—2,2]{dx) (such 
as Wigner matrix), with perturbation matrix A = 
diag(/V2,0...,0). 



-2.5 -2 -1.5 -1 -0.5 0 0.5 1 1.5 2 2.5 

(b) Spectrum of an Hermitian matrix of size N = 
2000, whose spectral measure tends to j5_i(c/x) + 
^di{dx) + ^Hsc{dx) and with perturbation matrix 
A = diag(/-\/2,0... ,0). 


Figure 1 . Spectmms of two Hermitian matrices with the same limit bulk but different 
limit spectral densities on this bulk, perturbed by the same matrix : both do not have 
the same number of outliers (the blue crosses “+”)■ 


A,u • ■ • 5 A,a, such that for all j, Rp.j{6i) appears A); times, so that, for a certain 2r x 2r non singular 
matrix Q, we have : 


/ 


( 8 ) 


J - Q ^AoQ - A 0 0 0 

1=1 j=i 


Rk,(9.) 


\ 






■ V' 

Pij blocks 


where © is defined, for square block matrices, by M © N : = 



and A is a matrix such that its 


eigenvalues 0 are such that ^0 = 0 or null. 

The asymptotic orders of the fluctuations of the eigenvalues of + Aa? depend on the sizes j 
of the blocks. Actually, for each 0,- and each ^ , <^ 1 ,™, }, we know, by Theorem 23] 

there are Pij x A,) eigenvalues A of Ha? + Aa? which tend to '■ we shall write them with a 
on the top left corner, as follows 


Theorem 2.10 below will state that for each block with size pij corresponding to Oi in the JCF of 

- ’ 

Ao, there are pij eigenvalues (we shall write them with pij on the bottom left corner : p.’. A) whose 
convergence rate will be As there are Pij blocks of size pij, there are actually Pij X A,f 

eigenvalues tending to with convergence rate (we shall write them p.'"^s,t with s G 

{I,..., Pij} and t G {1,...,A©})- It would be convenient to denote by Aij^n the vector with size 



















6 


JEAN ROCHET 


Pij X Pij defined by 

(9) Ay,» := 

In addition, we make an assumption on the convergence of 

Assumption 2.6. 

/ _ / . 1 \ \ 

converges in distribution and none of 


t<S<Pij ' 




(1) Thevector ( ^ j U 2 .^ 


its entries tends to zero. 

(2) For all k > I, all i E . ,q} and all n E . ,nii}, 




-(fc+i) 


ll{dx) 




U2. 


is tight. 


or 


(O’) For all i E {1,... and all n E {I,.. as N goes to infinity, 

vWfiTrte,-H«)-‘--i)') ^0. 


(F) The vector ^ — ^Tr — Hyy) converges in distri¬ 




bution and none of its entries tends to zero. 
(2’) For all k > 1 and for all i E {1,..., q}, 


\<n<mj 


vWu;T(|..,„-h») 




(fc+l) 


U2. 


is tight. 


As in [[Toll , we define now the family of random matrices that we shall use to characterize the limit 
distribution of the Aij^fs. For each i= 1,let 7(0,) (resp. 7(0;)) denote the set, with cardinality 
Ejii A',7> of indices in {1,... ,r} corresponding to the first (resp. last) columns of the blocks Rpij{6i) 
(1 < 7 < CCi) in 

Remark 2.7. Note that the columns of Q (resp. of (Q^^)*) whose index belongs to 7(0,) (resp. 7(0/)) 
are eigenvectors of Aq (resp. of Aq) associated to 0/ (resp. 0/). See |[l0l Remark 2.7]. 


Now, let 


( 10 ) 



\<i<q 

\<n<mi 


(M)e^( 0 /)x/(e,-) 


be the multivariate random variable defined as the limit joint-distribution of 


(11) 







\ (d) 

U2rQC£ 1 \<i<q ~ ^ 

/ \<n<mi jointly 

(M)ey(e;)x/(e,-) 







(which does exist by Assumption |2.6[ ) and where ei,... ,6;- are the column vectors of the canonical 
basis of C'^). 

For each i, j, let K{i, j) (resp. K{i, j)^) be the set, with cardinality j8/j- (resp. E/=\ A,/)> of indices 
in 7(0/) corresponding to a block of the type Rp,. (0/) (resp. to a block of the type Rp.(0/) for / < ])■ 

J l.j 
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In the same way, let L{iJ) (resp. L{iJ) ) be the set, with the same eardinality as K{i,j) (resp. as 
K{iJ)^), of indiees in 7(0,) corresponding to a block of the type Rp.j{0i) (resp. to a block of the 
type Rp. (Oi) for / < j). Note that K{i, j)^ and L(/, j)^ are empty if j = 1. Let us define the random 
matrices for each n G {1,..., m,} 


( 12 ) 




keK{iJ)- 

eeL{ij)- 


M 


0„III 



eeL{i,j)- 


O' 

and then let us define the Pij x j5ij matrix as 


M 


0„II 

j,n 


\.^k,e \keK{ij)- 
eeL{i,j) 


M 


0„IV 



eeL{i,j) 


(13) 



0, 


M0„iv_Me„ni 


J,n 


J,n 




O' I 

Remark 2.8. It follows from the fact that the matrix Q is invertible, that My^ is a.s. invertible and so 

is M^„. 

Remark 2.9. In the particular case where Aq is Hermitian (which means that = Q* and the 0,’s 
are real), then the matrces M ■' are also Hermitian. 

Now, we can formulate the result on the fluctuations. 


2.2.2. Result. 


Theorem 2.10. (1) As N goes to infinity, the random vector 


(A/j-,„) l<i<q 

l<j<ai 

\<n<mj 

defined at Q converges to the distribution of a random vector 

{^i,j,n) t<i<q 
l<j<ai 
\<n<mj 


with joint distribution defined by the fact that for each \ <i < q, 1 < y < Ct,- and \ <n< mi, 
Af- „ is the collection of the pi roots of the eigenvalues of some random matrix M^'. 

L’jJJl 'ij J ,,12 

O' 

(2) The distributions of the random matrices My^ are absolutely continuous with respect to the 

Lebesgue measure and the random vector (A°y \<i<q has no deterministic coordinate. 

l<j<a; 


Theorem 2.10 is illustrated in Figurej^with an example. We clearly see appearing regular polygons. 


3. Applications 

In this section, we give examples of random matrices which satisfy the assumptions of Theorem 
12.31 and Theorem [2.101 
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2.8- 

2.8- 

2.4- 

22 - 



0.2- 


Figure 2. Spectrum of a Wigner matrix of size N = 5000 with perturbation matrix 
A = diag(R5(1.5-|-2i),R3(—2-|-1.5i),0,...,0). We see the blue crosses “+” (out¬ 
liers) forming respectively a regular pentagon and an equilateral triangle around the 
red dots (their limit). We also see a significant difference between the two rates of 
convergence, and 

3.1. Wigner matrices. Let Ha? = be a symmetric/Hermitian Wigner matrix with independent 

entries up to the symmetry. More precisely, we assume that 

Assumption 3.1. 

Real symmetric case: 

< / < 7 < A, are independent, 

• The (W!\f)ij’s for i j (resp. i = j), are identically distributed, 

. E(Wyv)i,i = E(W^)i ,2 = 0, E(Wyv)li = 2a2, E(W;v)l 2 = 

• C3 := E I (Wa?)i,i 1^ < ms := E |(Wa?)i,2|^ < °°- 


Hermitian case: 

• (ReW^)^.^^., (imW^) \<i<j<N, (Wyv)1 <i<N, are independent. 

• The (ReWA?);j ’5, (ImWAf)ij’5 for i j (resp. (Wa?);,;’^), are identically distributed, 

(j2 

. E(W^)i,i = E(Wyv)l ,2 = 0, E(W;v)?,i = E(ReWA ?)?,2 = Y? 

• C3 := E|(Wa?)i,i|^ <'>°, ms := E | (Wa?)i,21^ < °°- 

In this case, we have the following version of Theorem |2. 3 1 
Theorem 3.2 (Convergence of the outliers for Wigner matrices). 

Let d\,... ,0j be the eigenvalues of such that 10,-1 > o. Then, with probability tending to one, for 
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all large enough N, there are exactly j eigenvalues Ai,..., o/H^y •= + cit macroscopic 

distance of [—2a, 2a] (outliers). More precisely, for all small enough 5 > 0, for all large enough N, 
for alii e 

~ a^ 

A,- = 0, + —+ o(l), 

after a proper labeling. 


Proof. We just need to eheek that Assumptions |2.1| and 2.2 are satisfied. 

- As long as the entries of Wa? have a finite fourth moment, we know (see [|2l Theorem 5.2]) that 
Assumption |2.1 1 is satisfied. 

- Now, we need to show that for any 5 > 0, as A goes to infinity. 


sup 

dist(z,supp(/i))>5 


U5Ad-H«)-'U2,-G„„t)I 


(P). 


0 . 


op 


Sinee we are dealing with 2r x 2r sized matriees, it suffiees to prove that for any unite veetors 
u,v of C^, for any 5 > 0 and any T] > 0, as A goes to infinity. 


PI sup 

'dist(z,supp(/i))>5 




> 1 


0 . 


Moreover, as both (z) and (zl — Ha?) ^ 


op 


goes to 0 when |z| goes to infinity, we know 


there is a large enough eonstant M sueh that we just need to prove that 


pf 


sup 

^dist(z,supp(/i))>5 

kl < M 




> V 


0 . 


Then, for any rj' > 0, the eompaet set K = {z, dist(z, supp(/i)) > 5 and |z| < M} admits a 
T]'-net, whieh is a finite set [zi,... ,Zp} of K sueh that 

Vze A, 3 /g |z-z/|<?7', 

so that, using the uniform boundedness of the derivative of (z) and u* [z — Ha?) ^ W on A, for 
a small enough r/', we just need to prove that 


P { max 
V 1=1 


u*(fcI-H«)-‘-G„„fc)I)v > 11 / 2 ) 0. 


Then, we properly deeompose eaeh funetion x hA as a sum of a smooth eompaetly supported 
funetion and one that vanishes on a neighborhood of [—2a, 2a] and eonelude using [|^ (ii) 
Theorem 1.6] 

Moreover, in the Wigner ease, we have 




Z—^zf— 4(72 
2^^2 ’ 


where ^z} — ^a'^ is the braneh of the square root with braneh out [—2a, 2a] so that for any z outside 
[—2a,2a], the equation Gp^^{z) = ^ possesses one solution if and only if |6| > a and the unique 
solution is 


0 + 


a 


2 


e 


5 


whieh means that in the Wigner ease, the outliers oannot outnumber the rank of the perturbation, 
and the phase transition oondition is simply : |0| > cr. Aotually in [Q (see Remark 3.2), the authors 
explain that if p is ffl-infinitely divisible, then the sets ^e/s have at most one element, whieh means 
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that for Wigner matrices, it is not possible to observe the phenomenon of “outliers outnumber the rank 
of A”. 

Remark 3.3. One ean find an other proof of Theorem |3.21 in Il28l as a partieular ease of the Theorem 
2.4 (see [|^ Remark 2.5]) due to the faet that a Wigner matrix ean be seen as a partieular Elliptie 
matrix. Nevertheless, the authors of f[2^ don’t deal with the matter of the fluetuations. 


□ 

To study the fluetuations of the outliers in the Wigner ease, we must make an additional assumption 
on the perturbation 


Assumption 3.4. The matrix Ajv has only a finite number (independent of N) of entries which are 
non-zero. 

Remark 3.5. Assumption |3.4| is equivalent to suppose that U 2 r (the 2r-first eolumns of U), possesses 
only a finite number K (independent of N) of non-zero rows. Actually, this assumption is the analo¬ 
gous “the eigenveetors of A don’t spread out” hypothesis eorresponding to the “ease a)” in [fT4l . 

Remark 3.6. If U is Haar-distributed and independent from W, we ean avoid making Assumption 
3.4|(see seetion 3.2). One ean also slightly weaken Assumption |3.4|by assuming that the 2r-first rows 


of U eorrespond to the N first eoordinates of a eolleetion of non-random veetors Ui,... ,U 2 r in £^(N) 
(see [l30l Theorem 1.7]). 


Theorem 3.7 (Fluetuations for Wigner matriees). 

With Assumtions 3.1 and 3.4\ Theorem 2.10 holds. Moreover, the distribution of the random vector 


m 


Oi 

k,£ I t<i<q 

(M)e^( 0 ;)x/( 0 ,) 


defined by ( fT^ , I 


IS 


{k,e)ej{ei)xi{ei) 


where := di-\- — and where T(z) is a K x K random field defined by 
Oi 


(14) 


T(z) := (Gp„(z))"(wW+Y(z)) 


where is the K x K upper-left corner submatrix of a matrix such that = '^n andY(z) 
is a KxK Gaussian random field defined by [|3T] (2.7),(2.8),(2.9),(2.10),(2.11),(2.12)] in the real case 
and [|3T] (2.42),(2.43),(2.44),(2.45),(2.46),(2.47)] in the complex case. 

A 


Remark 3.8. This provides an example of non universal fluetuations, in the sense that the 

are not neeessarily Gaussian. However, when Ha? is a GOE or GUE matrix, the ’s are eentered 

Gaussian variables sueh that 


(15) 


eT 


e,' 0 / 

\^k,i ^k’T 


117 1 0 / 

E I mfj^ 


= {etQ-\Q-^yep + 4 / 5 ^/), 
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for the GOE, and 
(16) 

for the GUE, where 

Wsc{z,w) 

(Psc{z,w) 


Vsci^iAi') 


4Q^HQ^'r^k' e^*,Q*Qe^, 


GlJz)GlJw){a^ + a^(p,c{z,w)), 

[ l^sc{dx). 

J z—xw—x 


We notiee that, if Q ^ ^ Q*, then we might observe eorrelations between the fluetuations of outliers 
at a maeroseopie distanee with eaeh other. This phenomenon has already been observed in [|25l for 
non-Gaussian Wigner matriees whereas, here, the phenomenon may still oeeur for GUE matriees. 
Aetually, ( [T5] ) and ( fT^ ean be simplified due to the faet 

<y^GlJz)-zGpJz)+l = 0 , 


, / N Gu(z)-Ga,Aw) . ^ 

so that (Psc{z,w) = - - - - - - satisfies 


Z — W 


(17) 

Henee, 


<^^G^sc(z)Gfi,,(w)(p,c(z,w) = (Psc(z,w)-G^^^(z)G^^^(w). 

GlJ^dGlJ^f) (a^ + ctV,c(^., 4-')) 


and we fall baek on the expression of the varianee for the UCI model (see seetion 3.2), whieh is 
expeeted sinee the GUE belongs to the UCI model. 


Proof. We show that the assumptions |3 .1 1 and |3 .4| imply Assumption |2.6[ more preeisely (1) and (2). 
Eor (1), we simply use [1311 Theorem 2.1/2.5] to show that 

vWU 5 ,(fe-H«)-‘-G;,,.,(z)l)U 2 „ 

eonverges weakly (as it is done in OOl f. The limit distribution is also given by Oil Theorem 2.1/2.5]. 
Then for (2), we know by dlU (i) of Theorem 2.3/2.7] (respeetively Oil (iii) of Proposition 2.1]) that, 
for all k > 1, the diagonal entries (respeetively the off-diagonal entries) of the matrix 

Viv((z-H^)-^-i- J {z-x)-’^-^^sc{dx)l) 

eonverge in distribution so that 


v^U^J (z-H^) 


-k-i 


A' 


-k-i 


f^sc{dx')\ j U2, 


is tight. 


□ 
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3.2. Hermitian matrices whose distribution is invariant by unitary conjugation. Let H^v be an 

Hermitian matrix such that for any unitary N x N matrix Ua?, we have 

(18) UyvH^U;^ H^. 

Hyv can be written Hjv = where Da? is diagonal, Ua? is Haar-distributed and Ua? and Da? are 

independent. We also assume that Ha? satisfies ([T]) and Assumption |2.1[ We shall call such matrices 
UCI matrices (for Unitary Conjugation Invariance). In this case, as we can we can write 

= H,v + Ayv = U^(D^ + U^AyvUiv)U;^, 

so that, without any loss of generality, we can simply assume that Ha? is a diagonal matrix and Aa? is 
a matrix of the form 

An = UirAoUl 

where U 2 r is the 2r-first columns of an Haar-distributed matrix independent from Ha?. 


Theorem 3.9 (Convergence of the outliers for UCI matrices). 

I/Hn is an UCI matrix, then Theorem \2.3\ holds. 

Remark 3.10. Unlike the Wigner case. Theorem |2 .3 1 does not need to be reformulated. In this case, 
we do observe the phenomenon of the outliers outnumbering the rank of Aa?. 


Proof. We just need to check that Assumption |2.2 is satisfied. To do so, one can apply a slightly modi¬ 
fied version of Lemma 2.2], where we replace all the “dist(z, [a, b]) > 5” by “dist(z, supp(/i)) > 5”, 
which does not change the ideas of the proof. □ 


For the fluctuations, we need to assume that for all / G {1,..., and all n G m,}, as N goes 

to infinity, 

(19) -^0. 

Remark 3.11. Actually, in [[^, the authors make the same assumption (jb] Hypothesis 3.1]). 


Theorem 3.12 (Fluctuations for UCI matrices). 

I/Hn is an UCI matrix, then if satisfies Theorem 2.10 More precisely, the 


l<i<q 
\<n<mi 

{k,e)ej{ei)xi{ei) 

defined by are centered Gaussian variables such that 



where 




m 





e}Q*Qee, 


d>(z,w) := [ - fiidx) — f - \iidx) f - u,(dx) 

J z—xw—x J z—x J w—x 

- (Gju(z))^ -.otherwise. 


Remark 3.13. Remind that we supposed that /i is not a single Dirac measure, so that is not equal 
to zero. 
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Remark 3.14. If is Hermitian, the size of all the Jordan bloeks are equal to 1 and the fluetuations 
are real random variables (see Remark [Z9l ). We find baek that, in the Hermitian ease, fluetuations 
between outliers at a maeroseopie distanee are independent (see [|6l) exeept if the two outliers eome 
from the same eigenvalue of A (i.e. they both belong to the same set In this ease, the fluetuations 
of outliers belonging to the same set are all eorrelated. This phenomenon is illustrated by Figures 


3(a) and 3(b) 



(a) Uncorrelated case : G^(^i) 7 ^ ( 1 ^ 2)5 which (b) Correlated case : G^(i^i) = G^(^ 2 )j which 

means that and ^2 do not belong to the same set means that 1*1 and ^2 belong to the same set 


Figure 3. Correlation between the fluetuations of two outliers 7 ^ ^2 for a sample 
of 400 matriees of size 500, in the ease where both H and A are Hermitian and where 
the support of /i is diseonneeted. Here iJ.{dx) is taken equal to + l[i, 2 ] [dx)). 


Proof. We just need to eheek that Hjv satisfies (F),(2') of Assumption |2.6| (sinee (O') is assumed 
below). Aetually, for any k>\ and any i G {1the diagonal matrix 




fulfill the assumptions of Theorem A.3, so that (2') is true. Then, (1') is true thanks to Theorem A.5 
This theorem also gives us the eovarianee. 


□ 


4. Proofs 

4.1. Convergence of the outliers : proof of Theorem |2.3t In [|5l|, the authors give an interpretation 
of why the limit is neeessarily a solution of (z) = ^ with the subordinate funetions of the free ad¬ 
ditive eonvolution of measures in the partieular ease where one of the measure is do (see (H Example 

4.1] ). Aetually, our definition of the sets ^e,’s eorresponds to the one of the set Oq in jS] Definition 

4.1] . A quiek (but inaeeurate) way to see why the limit is understand the approaeh of 

the proof, is to write 

det(z-(H^ + A;v)) = det(z-H;v)det(l-(z-H^)-iA;v), 
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then if (z — Hjv) ^ ~ (z)I, we ean write 

det (z - (Ha? + A^f)) ~ det (z - Ha,) (z) det 

so that if z is an outlier of Ha, + Aa,, must be an eigenvalue of Aa,. 

To do it properly, we introduce the following function]^ 

(20) /W = de.(l-Ul,(d-H)->U.A„) = ^7^-H.) ’ 

we know that the zeros of / are eigenvalues of Ha^ which are not eigenvalues of Ha,. Then, we 
introduce the function 


(21) Mz) := det(l-G^(z)Ao), 

and the proof of Theorem [2^ relies on the two following lemmas. 
Lemma 4.1. As N goes to infinity, we have 

sup |/(z)-/o(z)| ^ 0. 

dist(z,supp(^))>5 


Lemma 4.2. Let K be a compact set and let £ > 0 such that 
j 

- dist(i^,U^e,)>e- 

!=1 

- dist(^, supp(/i)) > e. 

Then, with a probability tending to one. 


inf 

zeK 


det I-(z-H,v)~^A, 


■N 


> 0 . 


If these lemmas are true, the end of the proof goes as follow. We know that, with a probability 
tending to one, there is £ > 0, such that 

- there is a constant M > 0 such that Ha, + Aa, has no eigenvalues in the area {z, |z| > M}, 

- Spec(HA,) C {z, dist(z,supp(/i)) < £}, 

We set 

i=l 

and we define 

(22) U U k-^l<e} 


with the convention that = (d if y = Q). Up to a smaller choice of £, we can suppose that none 
of the disk centered in the element of the yp -'s a nd of radius £ intersects each other nor intersect 
{z, dist(z, supp(/i)) < £}. Then, using Lemma 4.2 with 

K := {z, |z| <M}\(,5^^U{z, dist(z,supp(jU)) < £}), 


3. we used a classical trick of finite rank perturbation models which det(I„, + AB) = det(I„ + BA) for any mxn matrix 
A and nxm matrix B 
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we deduce all the eigenvalues of Ha? are contained in U {z, dist(z,supp(/i)) < e}. Indeed, if z is 
an eigenvalue of H^v such that dist(z, supp(/r)) > e, z must be a zero of /. 


Moreover, for each i G {1,... , 7 } and each ^ G we know that from Lemma 4.1 


sup |/(z)-/o(z)| —^ 0 , and inf |/o(z)| > 0 . 

z,\z-^\=e z,k-^l=e 


we deduce by Rouche Theorem (see [31 p. 131]) that / and /o, for all large enough N, have the same 
number of zeros inside the domain {z, |z — | < e}, for each ^ in the ,5^e, ’s. 

Now, we just need to prove the two previous lemmas. 

Proof, [of Lemma |4.1[ We know that, for some positive constant C, 


sup |/(z)-/o(z)| < 

dist(z,supp(/i))>5 


C sup 

dist(z,supp(/i))>5 



(z-H;v) 


-I 


G^(z)l) U 2 . 


op 


and we conclude with Assumption [2^ 


□ 


Proof, [of Lemma |4.2[ We write, thanks to Assumption [2^ 

det(l-(z-Hyv)^^A^) = det(l-U^,(z-H,v)-iU2.Ao) 

= det(I-G,,(j)Ao + D(l)) 

= n(i-G;iWei)+Ui). 

i=l 

Then, since z G it easy to show that for each /, 11 — (z) 0i\ >0. □ 


4.2. Fluctuations. The proof of Theorem|2.10|is the same than [[TOl Theorem 2.10] and all we need 


to do here is to prove this analogous version of lUOl Lemma 5.1]. 

A 

;iiiiiia ■•.J. rut un 7 c \ . . . , unu uu 11 kz . . . ,rnij, ict i' 

by 

z 


Lemma 4.3. For all 7 G { 1,..., Ct,} and alln&{\,...,mi}, let Fj^{z) be the rationnal function defined 


(23) 


CiW := /(?.> + 




Then, there exists a collection of positive constants {yi,j)i<i<q and a collection of non vanishing 

random variables i<i<q independent of z, such that we have the convergence in distribution 

l<j<ai 

l<n<mj 

(for the topology of the uniform convergence over any compact set) 


' i< rV: 


l<n<mi 


N- 


z G (U ^ ■ Q, ■ det ( z^' j - M2„ 


I<j<a, 

\<n<mj 


O' A 

where is the random matrix introduced at ( [ 11 ] ) and Ttij := Y,i>j 

Once this lemma proven, the Theorem [2. 10[ follows (see section 5.1 of [[T0[| for more details). To 
prove Lemma 4.3 we shall proceed as it is done in ifTOll to prove Lemma 5.1. First, we write, for a 
fixed 6i{= 6), a fixed n G {1,... ,m,} and a fixed 7 G {1,..., a,} (which shall be implicit) and fixed 
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Pij(= p), recall that Aq = QJQ ^ 

+ 'u>QJQ^‘u5.) 

= det(l-i-G'fe)^(l+»(l))J-^Z«(4, + ^)) 

where 

Zn{z) := V^Q-1u^,((z-Ha,)-1-G^(z)i)u2.QJ. 

Remind that by definition, G^u (i^„) = 0 ^ From here, the reasoning to end the proof is the exaet same 
than the one from [fTOl Lemma 5.1]. Nevertheless, we still have to prove that, for all 6 and for all n, 
for all eompaet set K and for all K, 

(24) Zi^{^n + J^i/(^ 2 p ) ) ^ Za/((§„)+ o (1), and Za?((^„) eonverges weakly. 

To do so, we write (thanks to |A.1[ ), 

+ ;^QU|,-(?,-H«) + U2.QJ + »(1). 

The last ter m is a o (1) sinee dist(i^„, Spee(HAf)) > £ and one ean eonelude if (1), (2) are satisfied in 
Assumption |2.6[ Otherwise, if it’s (O'), (T), (2'), we write 

+ vVQ-‘U 5, ((4, - H«)-‘ - ixrd, -H«)-') U2,QJ 
+ E (;^)* - iTr(4„ U2,.QJ 

+ ;^QU|,(6,-H„) + U2.QJ + .(1). 


Annexe A. 


A. 1. Linear algebra lemmas. 

Lemma A.l. Let A be a matrix and X be such that both A and A + AI are non singular. Then, 
for all p>l, 

(A + AI)^^ = f;(-A)*-iA-*+(-A)^A-^(A + Al) 

A:=l 


1 
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Lemma A.2 (Schur’s complement [|^ ). For any A,B, C,D, one has, when it makes sense 

/a bV^ _ / (A-BD-iC)"^ -(A-BD-iC)^^BD-i \ 

yC dJ ~ \-D iC(A-BD D i+D iC(A-BD iC)~^BD y 

A.2. Fluctuations of the entries of UCI random matrices. We give here some results on the flue- 
tuations of the entries of UCI matriees, whieh means, matriees of the form H := UDU* where U is 
Haar-distributed and D is a eomplex diagonal matrix. 


Theorem A.3 (Fluetuations of the entries of UCI random matrices). Let T be an N x N diagonal 
matrix such that 


(25) TrT = 0, ^TrTT* ^ 


^TrT^ ^ 


V/t> I, ^Tr(TT*)* = 0{r 


Let Ufj,..., u, be p distinct columns of a Haar-distributed unitary matrix. Then 


p 

'J=i 


Viv(uf,., TUf.)j 

converges in distribution to a centered complex Gaussian vector with covariance 

E [^iAi] = 5,-^5,,; E = di^kSpiO^ 

Remark A.4. If H : = UDU* satisfies ([T]) and Assumption |2. 1 [ then T : = D — ^ TrD satisfies ( [25| ). 

Here eomes a version of Theorem |A.3[ with several matriees diagonal T. Due to the eomplex 
values of the diagonal matriees, the following theorem is not a simple eonsequenee of Theorem | A.3 1 
and Cramer-Wold theorem. 


Theorem A.5. Let Ti,... ,Tq be N X N diagonal matrices such that for all m,n ^ {1,..., 

TrT,„ = 0, f TrT„T: ^ <7^,,. ^TrT„T,. ^ Vt> 1. 2Tr(T,„Tr„)‘ = 0(1). 

Let Ufj,..., U-tp be p distinct columns of an Haar-distributed matrix. Then 

\<i<p ; 

^ ^ 1<;<R 

\<m<q 

converges in distribution to a centered complex Gaussian vector \<i<p with covariance 

i<j<p 

\<m<q 




Proof of Theorem A.3t Without any loss of generality, due to the invarianee by eonjugation by a 
matrix of permutation, we ean suppose that ti = l,t 2 = 2,... ,tp = p. Then, we just need to show that 

X = ViVTr(U*TUA) 


where A is a A x A deterministie matrix of the form 


A 


Ap 0 \ 

,0 V 


Ap = 



G ./^p(C), 


is a asymptotieally Gaussian. Before starting, we remind some definition. Let (Mi,... ,M^) be q 
matriees. For any permutation o G Sq, with eyele deeomposition 

<7 = 
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we denote by 
(26) 




r 



For example, if a = (13) (256) G 56, then 

Tra(M,)^ti = Tr(MiM3)Tr(M2M5M6)Tr(M4). 

Let M(2n) be the set of all perfect matching on {1,..., 2n} whieh is a subset of 52„ of the permutation 
whieh are the produet of n transpositions with disjoint support. For example 

M(4) = {(12)(34),(13)(24),(14)(23)}. 

Then, if the following lemma is true, one ean eonelude the proof. 


Lemma A.6. Let Ti,... ,Tq be q diagonal matrix such for all i,j E {1,..., q}, 

(27) TrT, = 0 ; ^Trl,-!,- ^ > 1, ^Tr (T,T*)^ = 0(1). 

Let Ai,... ,Aqbe q matrices of the form 


A, 


Ao,/ 0\ 

0 o) 


where the Aq/s are K x K matrices independent from N where K is a fixed integer. Let \J be a Haar- 
distributed matrix. Then, as N goes to infinity, 


E 


fjViVTr(U*T,UA,) 


r=l 


qjl 

52 Tr^j (A,')J^j ]2[T(7(2f-i),c7(2f) 
aeM{q) t=l 

0 


if q is even, 
if q is odd. 


Indeed, onee we suppose Lemma [AT6| satisfied, we need to eompute for all p,q 

[ ViVTrU*TUA] ^ [ ViVTrU*T*UA*] ‘ 


E 


[VATrU*TUA] ^ [ ViVTrU^TUA] ‘ 


= E 


in order to apply Lemma [A77| Aeeording to Lemma [A!^ for Tf = T and At = A, we have 

Erv^TrU-TUAl’ ^ fCardM(«)Tr(A^)«/2W^ if q is even, 

1^0 if q is odd. 


(remind that CardA/(^) = (^ — 1)(^ — 3) ■ ■ ■ 3) whieh means that the limit distribution of X already 
satisfies ( |30l ) and ( [3T| ). Let p > 1 and ^ > 2 be two fixed integers sueh that p + ^ is even, then, using 
notations from ( |2^ , we know thanks to Lemma [A^ that 


(28) E 


[ ViVTrU^TUA] ^ [ ViVTrU*T*UA*] ‘ 


£ Tr,(A,)f:fTr,(T,)fJ + o(l) 


p+q 

A 2 a^M{p^q) 


where 


(Ti,...,!;,+,) = (T,^,T,r,...,rj and (Ai,..., Ap+,) = (A,..., A, A*,..., A=^ 

p 


q 
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We rewrite the right side of ([28]) summing according to the value of O'(l). 


p+q 


E Tr^AOfjTr^TOfJ = £ E Tr, (A,);'jTr„ (T,)fJ 

C7izM(p+q) a=2 a^M{p~\-q) 

a{\)=a 


P+q 

1 £ Tr^o(i,)(A,)fjTr^o(i,)(T,) 

£Tr(AiA,)Tr(TiT«) 

a=2 

C>eM{p+q) 


a(l)=a 

^TrA^TrT^ £ 

Trcr (A,)f+/^2Trc, 


p+q 


a=2 


aeM{p+q—2) 


p+q 


+ Y, TrAA*TrTr Tr^, (A,)fJ "Xr^ (T,)fJ ", 

a=p+l (7eM{p+q-2) 


\p+q-2 


where 


(Ai,...,Ap+,_ 2 ) = (A,..., A, A*,..., A*) and (Ai,..., Ap+,_ 2 ) = (A,..., A, A*,..., A*). 


P-2 

At last, one easily deduces that 




P-1 


q-\ 


E 


[ViVTrU*TUA]^[ViVTrU*T*UA*]^ =-TrT2TrA2(/7-1)E [ViVTrU*TUA]^ ^[ViVTrU*T*UA*] 


N 


+ -TrTT*TrAA*flE 
N ^ 


[ViVTrU*TUA]^ ^ [ViVTrU*T*UA*]^ ^ +o(l) 


q-l- 


and so A/iVTr(U*TAU) satisfies ( [3^ which means according to Lemma A.7| that its limit distribution 
is Gaussian. 

At last, to compute to covariance of the {^ij) ’s, one can simply use IfTTl Lemma A.6]. □ 

Proof of Theorem |A.5[ This time, we shall use Lemma [AT^ to show that for any Ai,..., A^, N x N 
deterministic matrix of the form 


A 0' 

0 0 , 


V».p=(«y)L.,e-<«'p(C). 


the vector 


i Tr (U*TiUAi),..., 1 Tr (U*T,UA,) 


converges weakly to a Gaussian multivariate. Thanks to Theorem A.3[ we know that for each m, 

^Tr(U*T„UA„) 


N 

is asymptotically Gaussian. Then, we show that 

r / 1 \ ^ 

E f-Tr(U*TiUAi) j f-Tr(U*T^UA|) 

satisfies ( [35] ) and ( |3^ using Lemma [A3j 


1 \ / 1 ^ 
- Tr (U*T,UA,) ) ( - Tr (U*T;UA;) 


N 


□ 


Proof of Lemma [A.6[ We know from ll26l Proposition 3.4] 


E 


q 

: 

f=i 


nViVTr(U*T,UA,) 


AI?/2 £ Wg(Toa-i)Tr,(A,)f^Jr,,(T,-)J^j 


(y,TeSa 
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where Wg is a funetion ealled the Weingarten function. Moreover, for a G Sq, the asymptotieal beha¬ 
vior of Wg(o') is at most given by 

(29) Wg(c7) = 0{N~^). 

First, one should notiee that if o has one invariant point (whieh means a eyele of size one in its 
eyele deeomposition), then 

Tr„ = 0, 

also, if o has r eyeles in its eyele deeomposition, then, by the Holder inequality, 

Tr„(Ti)t, = 0{N''). 

Aetually, the maximum of eyeles in its deeomposition that ean have o without any 1-sized eyele is 
. 2 . 


so that, using p9| ) 

iV^/2wg(cyoT-i)Tr,(A,-)tiTra(T,)L^ = 
so that first, if q is odd 


E 


nViVTr(U*TfUAf) 


f=i 


= 0 ( 1 ). 


Moreover, if q = 2r, then the only way to have 

is to have 

- T = a, 

q 

- (7 is a produet of - = r transpositions with disjoint support. 
One easily eonelude. 


□ 


A.3. Moments of a complex Gaussian variable. The following lemma allows to prove that a ran¬ 
dom variable is Gaussian if and only if its moments satisfy an induetion relation. 

Lemma A.7. Let Zbe a complex Gaussian variable such that 

E[Z] = 0, E[Z^] = E[|Zp] = 


(30) 

Then, for all p>\ 

(31) E[Z^P] = pWz^P and E = 0, 

also, for all p,q >0, 


{where p\\:=^^) 


(32) 


E 




= o'^{q + 2)E 




-fT^(p-bl)E 


ZPz^+2 


o'^{p + 2)E [z^+^Z^+M +t2(^+i)e [Z^+2z^] . 


Conversely, any complex random variable Z satisfying ([30l),(|3T]) and ( [32| ) is a complex Gaussian 
variable. 

Proof. First, recall that if Z = Ai -|- iA 2 is a complex random Gaussian such that 

E[Z] = 0, E[Z^] = E[|Zp] = 
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then, its Fourier transform is given, for t + it 2 G C, by 

:= Eexp(/(Xiti+X2t2)) 

1 


= exp ( --((tf+ + -t|)Re(T^)+ 2 tit 2 lm(T^)) 


We define the differential operators 

(33) dt := di+id2 ; dj di—id2 
so that 

(34) E[ZPZ^] = 

One can easily compute 




therefore, for any p >0, q >0, 


a,'■+-*(») = ap+> 

= -i((j^a,'’+‘<l>(<) - ]^Tridp'^(t) - -rip + 1)5,'’<!>(<) 


= - (T^ (^4'’+ U«+2*(i) + (? + 2)3/+ ‘ a«+ ‘*(i)) 

- + (P+ i)a,'’ar'<i>(»)). 


hence. 


E[Z^+2] = t2^p + 1)E[Z^], 


E 


= o'^{q + 2)E 

1 1 
N 

+ 

+ 

-fT2(p+l)E 

ZPz'?+2 

and the same way. 







E 

ZP+2 

= t2(p+1)E[ 




E 

+ 2 ^ “1” ^ 

= cj2(p + 2)E 


-hT2(^+l)E[z^+2z'^] 


Conversely, one can easily prove by induction that any complex random variable Z satisfying (|30l),([3T]) 
and ( [32l ) has all its moments uniquely determined and since the complex Gaussian variable also satis¬ 
fies ([30|),(|3T]) and ( [32| ), one can conclude. 

□ 


More generally, one can show the following lemma 



















22 


JEAN ROCHET 


Lemma A. 8 . Let (Xi,..., X^) be a centered complex Gaussian vector. Then, for all non negative 
integers pi,qi,... ,pr, qr, for alii ^ { 1 ,..., r} 

if Pi >1, E ■ ■ ■XP’-X^^] = {pi - 1)E [X^] E ■ ■ ■Xf'~^X^' ■ ■ ■XP'^X^^ 


(35) 


+ Y,Pj^[XiXj]E 
j=i 
j¥=i 

;=i 




ifq,>f E[xP^Xi^X..xP'Xr‘^^] = (^,--l)E 
(36) 




E 


Xf■ ■ ■XP‘~^ ■ ■ -xj^ ^ ■ ■ ■X/^'-X/^ 
■ ■ ■xP%‘^‘~^ ■ ■ ■xP’-X^'' 


+ Pj E [X,X^] E [xf'Xi^' ■ ■ ■ Xf" ^■■■Xp ^ ■ ■ ■ X/^'-X/'' 


+ ^^;E[x;^E 

j=i 

m 


Xf'Xi'^* ■ ■ ■ Xf ■■■Xf ^ ■ ■XP'-Xr‘^'' 


with the convention thatX^^ = 0. 

Conversely, ifX \,... ,X^ are r centered Gaussian variables satisfying ( [35] ) and ( [36l ), then (Xi,... ,X^) 
is a centered complex Gaussian vector. 

Proof. In the same spirit as the proof of Lemma |A.7[ we obtain ( [35] ) and ( [3^ by derivating the Fourier 
transform. The eonverse is proved by induetion. □ 
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